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RECEIVED 


Convergence Analysis of Block Implicit One-Step Methods for 


Solving Differential/Algebraic Equations 


Abstract: We will prove that numerical approximants, generated by fixed- 
stepsize, fixed-formula (FSFF) block implicit one-step methods, spplied to 
smooth, nonlinear, decoupled systems of differential/algebraic equations 


converge to the true analytic solution. 


Key Words: fixed-stepsize, fixed-formula block implicit one-step methods, 


Banach space, Frechet derivative, Kronecker product notation. 


Introduction: 

In this paper, we will consider some theoretical properties of fixed- 
stepsize, fixed-formuls block-implicit one step methods that underly our 
numerical implementation in [5S]. Of central importance in this theoretical 
discussion is the question of convergence. We will determine whether the 
approximants generated by our nurnerical algorithm approach the 
corresponding analytical solution as the stepsize h approaches Zero - and, if 


sa, what order inh this convergence follows. 


The first section of our paper will contsin a derivation of our FSFF 
method and same theoretical tools necessary to prove the convergence of 
these methods. The second section of our paper will contain some 
theoretical tools necessary to prove the convergence of FSFF block methods 


In section three we will prove that our FSFF block implicit methods are 


consistent. In section four we will prove that our FSFF block implicit 
methods are stable. Finally, in section five we will use the fact that 


consistency and stability imply convergence. 


1. Derivation of FSFF One-Step Block Implicit Methods 


vi = tite CR) ‘emer 
subject to the initial conditions 

y(¥o) = Yo 
such that 

x € [Xo,%finl, 

yIoXtnd PR, 
and 

{%o%Fnd X ROR" 


is (00, Lip) on the region [Xp,%ginl X R’. 


We can think of the main idea behind fixed-stepsize, fixed-formula 
(FSFF) block-implicit one-step methods for solving (1.1), as going from X 


to %k+r by approximating the integral in 


\ 


ker 
eee { fay) dx = 0. (2) 
Xk 


We are particularly interested in the class of FSFF block implicit one- 
step methods analyzed by H. A. Watts in[7]. Watts considers the grid paints 

Nay | yc Bom jh, mh@ (0) Xpn\= Kol; j= 0, 1) 2, I, (1.3) 
and generates the sequence {y;}, such that y; approximates y(x;) (the 


analytical solution to (1.1) at the point x;). Watts defines 6 FSFF block 


implicit one-step method as 6 procedure which, when applied to 4 single 
equstion of the forrn (1.1), yields r additional values Uee1, Yeez, «-. Uker 
simultaneously at each stage of the application of the method where k =mr, 
Hana aliees ea: 


A FSFF block implicit one-step formula applied to @ single explicit 
ordinary differential equation of the form (1.1) takes on the following form 
in (7): 


r ff 
DY BijWpajy = CU, * MZ + NS Sijreez (1.4) 
j=! : io 


such that 
@;;, 6ij;,e,, die R 


and b= i,j sh 


Suppose for notational convenience we let 
A = [a;}), 
B -= (6:3), 
= 
e = [e;,e2,..,e,] , 
: 
d- (1, d2, or d,| ; 


7 
We = (Uper Seem > Uner! > 


Zk = YE, 
‘ 
Zin bein Zheds -, Chav! 


[Neo Fe 


n 


Therefore, equetions (1.4) cen be concisely written as 
H ' Cc: 
Ay,, = hBz, *e, + hdz, a 
Assuming that A ‘existe, we will further simplify system (1.5) te cotain 
Y.. = bet we Leer hd2;., it 6} 


Lin hiaing thertraneeker product notation, FSEE Bleck implicit ane-ctea 
methocs may be applied to a nonlinear, decoupled system of 


gebraic equations cf the form 


[Ean SV zated) | 


a apes 
Filey (eaten | = 


WOJeCt ta the initial canditians 


such that 


€ [Xo.%einl. 


[xo Xen, | x Rn X Rn Rn 


Falxa,%rin) X Red X Raa XxX Rad Rnd 
EF: [Xo,Xfin) X R2d X Raa >Rna 

Ya [Xo,%¢in] PR 

va [%0,¥ fin] RO 

v(x) := [yal (x) yal (xd]T, 

ey 


n:=nd+na, 


and the Jacobian matrix [4£4/32,] is of maximal rank on [Xo,X¢inl. 


If Fis twice continuously differentiable, then it can be proved, via 
generalized Picard-Lindelof theory [5], that the solutions to systems of the 


form (1.7) exist and are unique. 


For notational convenience, let us define the following nr-dirnensional 
arrays Um, Zm, Up, and Zp, to be 

Um := [veo ™, Yee2", .... Peer IT, 

Zen 2= Um = Weel, Yee2", Veo I, 

Uo := lyol, vol, .... yo IT, 

Zo = Wo = [20', 207, .., OT, 

k= min, 
and 


Hier t 2.3 


poses 


Let us utilize the Kronecker product notation to define the following 


matrices: 
P i= ae x In 
BES 2p: 
Re= D- 2h, 
such that 
02200) 
ps OO" 
dip c= 
OO ; 
Or 0 4 
ONESO' de 
ib ' 
©. 10 dy i 
Kee mane 
muaOeal, 2 ins; 


fe, Dre Row 


and I, is the nan identity matrix. 


To advance our numerical method from xX, := Xmr tO Xker 7= Xmetr, WE Will 
require that Un, associated with the interval [x.. xe]. satisfy the 
equations 

Falxkei Yo pair Pa kee 2d kei) = Dy Kot 

FalXkei, Ya k+ir ere = Da k+ir (1.8) 


for 12 i<r, and sirmultaneously satisfy the block discretization formulse 


Pils + AO + RZmn-1] (1.9) 


i] 
i 


1... 
Bi 


The second section of our paper will contain some theoretical tools 
necessary to prove the convergence of FSFF block methods. In section three 
we will prove that our FSFF block implicit methods are consistent. In 
section four we will prove that our FSFF block implicit methods are stable. 
Finally, in section five we will use the fact that consistency and stability 


imply convergence. 


2. Theoretical Tools 


The notation presented in the previous section will now be utilized to 

consider some theoretical pronerties of FSFF block methods. Of central 
importance is the question of convergence. We will determine whether 
approximants generated by our numerical algorithm approach the 
corresponding analytical solution as the stepsize h approaches Zero - and, 
if so, what order inh this convergence follows. More specifically, we will 
prove convergence of FSFF black methods (1.4) when applied to smooth, 
nonlinear, decoupled sustems of differential/algebraic equations of the 
form (1.7) via obtaining the following classical result: 


“Consistency + Stability = Convergence.” 


In [4] H. B. Keller presents & general abstract study of methods for 
approximating the solution of nonlinear problems in & Banach space setting. 
His basic result is as follows: // @ nanlinesr problem hes @ ungue lace? 
ONnEIYWLICE) SQIULTON, GAO HS Consistent GLE OsHN6tNG Preble hes @ stét/e 
Lipsthite continuous linearizeiian, Uren the appr ashngting problem AEs & 


stéhle selution whith 18 Close ta the 6nelurice? sahitien 


Keller considers the problem 
Gly} = 0, (2.1) 


such that 
GB, =? Bio, 


{B,", Boh}, the family of approximating problems, 

G,(v,) = 0, (2.2) 
where 

G,:5,4 + Eh, 
and 

O<heNp, 


are slso considered in [4]. 


To relate problems (2.1) and (2.2), Keller requires that there exist a 


family of linear mappings {P,*, Po} where 


RieB, a Bi (2.3) 
and 

hull - (2 4) 

iro IPPyll = Iv, (2.4) 


for all ve B; (i = 1,2). For notational convenience the following is defined 
in [4]: 

[v},, = Phy, (2.5) 
such that [v}, e Bi if ve B; (i = 1,2). 

Before we define consistency, stability, and convergence, we will define 


a sphere about an arbitrary point in 6 Banach space B as follows: 


Definition 2.1: The sphere of radius ¢, about u e B, is defined as 


follows: 
S,(u) := fv: v eB, Ilv-ull <p, p> 9.0 (2.6) 


Now we are prepared to state the definitions of stability, consistency. 


and convergence, to be utilized in our analysis. 


Definition 2.2 [4]: The farnily {6,()} is stadJe for ue B, if and only if 
for some fig > 0, p > 0, and some constant M, > 0, independent of h, 

Ivy - Wl ¢ MyHG,CY,) - GyCrp IL, (2.7) 
for all h © (O,ho], and sll vy, w, © S,(fu},).0 


Definition 2.3 [4] The family {G,()) is caasistent of order 
p21 with GC) on S.(u) if and only if 

Hey (v all = UG, C¥},) - [GC a], ¢ Mev dhe, (2.8) 
for all ve S,(u), and some bounded functional M(yv} 2 0 independent of h.O 


Suppose u is @ unique locs) analytical solution to system (2.1). If we 
substitute u for v in (2.6), we obtain the following: 
I, (udil := WG,Clu} Hs MCudhe.0 (2.8°) 


The significance of definitions 2.2 and 2.3 derives from the following 
theorem from [4]. 

Theorem 2.1: 

Let 

Glu) = G, 
and 

G,(w,) = 0, 


Jos 


for some wee S (luki.o > andallhe (Ono! Let iit) be stable tor u 
7 ia “ io ==. Ts 1 ¢ . ’ - . \s 


anc consistent of ardero: | with Gi} at u 
Then 
Fiero ated piesa ae Aga 2 ~ 
Nuh, ~ wy lls Artur, (29) 


m= he sane} 
far moe QO 


Utilizing theorem 2.1, we will formally define convergence, end the order 


of convergence as follows: 
Definition 2.4 A sequence of numerical approximants Ww, € S. (ful. 15 


eaic te caaverge tos unigue local enalyticel sclution u of (1.5) 1f 


lim ilu), - vill = 0 (2.108) 
hd 


forall he (O,hy)] The aréer af convergence of this 


m 
(a 
a 


sequence is pif there exists sorne bounded functional Mu) 2 0, independent 


uj, - wall ¢ Méun’.o (2. 10h) 
Set Us recall the definition of  Frechet derivative of a bounced mapping 
H{-), such that H:5y-3 Bs. 


Definition 2.5: [f there exists a bounded, lineer operatar 


Liv):8, > Bs, such that 


=) 


HAs = Bit = Loe isel 
aaa es 


{I qo lvl] (2 1 15 
hese is 


on 


ape ging Sur FSFF bicck metheds te systems of the form (i.7), consistency 


an 


15 GeLermiines Oy simple Taylor series expansions. Because the stabiity 
verification for general nonlinear problems of the forms (1.7) 1s nate 


3" Grocecure, we will proceed as in [4]. In perticular, we wilt 


-4¢ sft ai ee ee eee ee epa te oe Tey 
= legen at WheSMiees ran Goer, SMa wen oerid he 


em from {4}: 


- - Pisa ' -¢ x ceiesone fie of Ss mrsiistyiice os 
Let the family of mappings (o,0 2 have Frechet derivetives on 
- ~ ' 
Saaremaa pret iliita) Ae ees Pas pee ea omnes oh) eprttdlsieses Saeco ne 1k 1 
some fsmliz oT spheres Sp.fw,) and satisfy for ell he (Oh) 
fey ft sae OY) bs te. wpe Tye bee ded imap se 24 cen ~=. 
Ci {Lowe have unifermly Sounded inverses at the centers of the 
A 
ip tO 
fay 
ASe BSG 
na A leat WD) ere: Spore Tis fF opmebstae ae oem ome foes . @e at Se 2 
(aac Ng SUN LSE a A ae Ligschite Sonkinusus on Seale tip) TSU is, ton 
» 0 
aed 
Wee 1g I ", pS. ed a Bnd 
Neneh Heeahedl = pith me fSinies =I 
\ 
Por sity = ‘ 
bat Dik N 87— S Sell, 
Fou lifsll ie oyety or ocean ethane $k Sarees! fi LX) we at Sete) Sate (ool 
lf wi, = iain, HOn Sots ue Bi, then the tamily Uap A riche) me cee oa hee 
Ti - rope eee spe fees Fal eee eee tee sure ter rs ne it fs 1 -- 
Heat Blow Trg Rei SUPE tr Sine to tilole te ne Cairscelee Ur SG Torrie tae 
- sagem fas on t- =- mae reece = Jem ad emlyisian t @ FF: 1% 
solutions {w,} which auproximate a local solution u of (1 


ch 


Thearem 2.2: 


i -4 ey ee ee ee ee FF [wh Ghe © ae on She 
bet = ui Be a enigue lece! solution Gi (2.1). Let the family Se 
consistent Gi orderps 1 with GU) atu. Let the nusathesis (1) and 
re rn Or ce 2 area Pea tara 
= ec eT 3 
bem ps me and fb Moye Fyesoe ds] ee ares . =4-h 
Then, Tor p, > Gand h, > O sufficiently small, end tor eachhe 


fas @ unique sciction vy = Ww, = Sagilul,). These solutions catist 


Writ ane Wg bt qf VER 
Vi aby Whi Sap Ne, 


Convergence - Ordsr of Cancistencu ” 
Ucs: of LONVergence = order OF Lonsis eAcu. 
So we Seve convergence ff ac nt 
aol, WWE HGyYoS Liiiys: gonle ] . =—7p ae 
tod - e. en ee Se ws e 9 bh Dees) See eee sta 
Pet US Wirecuce the concerts of the [Ocel gistrevizevem it 


Definition 2.6: 2 wil! define J, tc be the Jace? diseretizetian 


éffar st the min step: thet is, 


Try = thee Beez Ber, 
\ 


ie se 
- 
wt v >! hie ha ory | 
fs, = Are © int Sean = ti =, viyeiay + yf} — mhapse apt, 
= 
t-. 
1 Jie (eS 


{3 15° 

+ om. a) 
Cant ater Noelia arid 
a ee ee 

f + thot 

cee eee 

ANG 


= = s<=::5 ‘--2) 2. 27::4 eT eatredsap om = ety 

153 UF Gude (bec) Gig. Si suiuuiln cd ce rival 
Pak ayes cece ove FA TT] sea lo) engfee 6 Pelee | 
Fe abchers if pei. icf, ENG (5; TEeler LC | eer sae | 


4aC8/ (rvaceéiiah efrasrs. 


Lefinition 2.7: The 


(ipa, Slime pe 
eke ee 
= LK: ¢+ = hb 3+) 
+ Cc Hels 5fhe ae 
i i MS 
Se 
a 
CG; = © 
eo Sa seco 
Tr Speer 
iisU i 
ous 
rr 
1 SE ae 
SS hee ere} 
\ 
hada Sh sence = Wee aa = (3) ¢p- <¢ FEES 5 
Ms Seat anil Boletos & ee tag ache Vine: s 
a = 
As Fa apo as 
BSH Hea 


QvErEH] OFEET Kee ger CF 
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Seo ASS 
rs 
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3. FSFF index One Consistency Analysis for Smooth 


Systems of Differential/Algebraic Equations 


- we. Ato) weds : -F ype 3 fm p= =P. d- ~. 
N Soest une |S Sido o:Ey Spy Gelined in (aa correspond: SC 


— . . om vi . Geta ’ acer - ie +% —_— . 
feryvir- Pras Vals 3! ae a a - lecealat 
EY SUE) (ULSD Dora a sei a4 Ss 
Fale yew fet) 
= —j Sdemcy, 
qiuck ¢h a4 
eee (ie aN 
gS Wate net aa 
nw th) eS DO 
ese = i 
or - in af tt Ti 
eS rea 
uel a, }— be 
ee ra, R 
uit {— iste} 
ad Ott R 
} _ }— Bra 
vl Ba R 
= of ig 
24:1kg.% Fin! > R™ 
idt+ng=n 
\ 
=u 
— hae oa ihe 
SPS YS oO Shy ee 
mie Renee ceate a) Cahaists o. tne nen tC Be werines iim og) gene ice 


Ty5 Saad RPE x RM x RN, 


fort) cr (ua Mayl We will denote this Banech space as 


ia] 
= 
we 
a 
wn 
we 
we 
— 
Fae; 
ee 
—_ 
~ 
—= 
=~ 
> 


we t 2 Sin. — Pods Roa. Prd 
which gre of class £Y on [xo ua.) We will denote this Banach space és 


Crilks Myint, Roe Res Ro The elements of &, are of the form 


es [yl gat T 
eae 
= [¥eg)7) Mpa}, wT IT 
such thet 


aa iisal 

fee Bit = 1,2), then we will let the norm of # be defined a: 
\ 

feels sumdliwdl  livell ft 


c= Suptlveanll ., lvpayll . livll 3 


cup Wy Gell, SUD yeh =» © fxa.%tad 


| 
Vsjsnd ~ ‘nd #4 $« 3h 1 2lsnd 


lf v is asolution to (1.5), then (3.29) reduces to 


els supilivll 


= SUBIIMST  Hgll , Myegll (3.20) 
Let us consider the fallowing family of grid points: 
My c= Kg +h fa mh 


fs 
5 


Focauce of the manner in which his defined, we see that 


ey = SFin 


For notational convenience let us define the following r-nd-dimensional 


Wind ra] = [va net, oy Ya ker IT ; 


Undo} = aol, my wa oT] 


Zing im] = east Oo Za ker IT, 


Ein Amy = = 24.0", eae Za gill. 


, 


Ja 


Also, let us utilize the Kronecker croduct notation to define the 
Toliowing matrices, which will be utilized to extract the equations 
carresoonding ta the differential variebles from the difference equatian: 


defined in 01a): 


Fread] = if, x Und On, cell 


where &., 6, and 0, are defined as in equation (1.5). 


Fer each such grid of the forrn (2.2), we can define the following difference 


ecneme 
-};! tS if (7 As} 
a Visa. nm) Pind Un-1 hiding} Zand, mi* Find ind, m-1]'? = =r-nd, Los 
ie as Zn aa ip ; iets 
Sd hei 2a, kt Ba kt Eq keril = Ud kt avi See 
She ae Ut api te , i ees et 
Pal Sitis Ld kta Ze koi! = Da kei ae 


Cina) *= C1291 8; "(Gingy*Ringy& -- 2" (Ojnay* Pinay le! 


ib ee fan Hal 
oe 
\ 
Ss ae 
arid 
we 
Cee 


The Eanach epaces 6) (i = 1,2) consist of the norm to be 


defined in (2.5), and the (nend)K-dimensional Euclidean space 


(Res Ro» ROK The elements of Bj) are of the form 


i} 
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i" 
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mae i eal 
Shoe Sey Eee yt TH 


MEST Patent lass etl a ein Aeiy 
= dient al Ml yd) ae) EK: | 
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oo 
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‘w 
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' 


— and 
he Ses, 
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qe saQq 6 Ty 
Hae Raat Gi 
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Mote 
VT ae AA 
r= lye 


if, e EX CG = 1.2), then the norm of #, will be cdetined as follows: 


STM MGA bee i MGA Ve Gi TS we qi 1 3 3 Ka. 


RAN rice GaenInGt sctesn ee |e siisnd 


em 


K,, 


We ys a soiulion te (2 iy then. ov... for l<s 


hate] he 
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Pe SY 3 SED AY? We’ cav!}! 
— =, a —-.N 


cerresnonds to the (n+ ndiK. diecrete equations detined in 
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reguces 


io 


Tt 


sre oth, oe mecaned ae G “rage 
wich Ys GEIMES GE raay a. 
Pel, 2 San FS fu = vi Ce el 
12 an -= ve = Bie} 1 SS) bey 2 Ce: 
Sue iene t 
eee = ES 
. eos] 
(|S Wee 
Ayo) GS oosottt Pro, of aoa 
ong 32 Wile ve siwervdi, 
Varah cell otal a7" 
bordl I pees Y EC fer se L& a 
ho 
- a ss im if ny A $m 2 = =, = = 
if vie @ solution 1), then ge coy, and (2.64) reduces te 
‘ by ae fevtus bee ie eee 1 Ter 
ean = Ph 4 =- CLO ae a 1 Be een (Zee) 
a\ias So ceqoS S Ayos - a ge c8 Apo hPa ears 
mist, Delsuse We Gi VW art Wig srikei SINGS uh funsuil hs, 
gris Geiines oy (2.2) Becames Genser, the méeximum value in t3.6. will 
eaten Sean stan Stee anes Ola a1Sroaae Gry fice Sat) Gosqecne 
e suigremum in ia.2). Thus the limit in (2.7) exists 


3.1 Proof of Consistency 


Now We 6re equipped to prove that cur FSFF Clock impiicit one-step 


methods (19). spphec ta smooth, nonlinear inges cne systems of the torr: 


(1.7), ere consistent with GG) et the solution y -= &:7 a TIT - es defined in 
Gefinitian 2.5. Using natstion similar ta that utilized in (2.2), we odte 


the Toilowing. 
a 
Tz) = Ble] 
= {ye fof ey Fy (el, {Sa} 
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We C54 how summarize cur FSFr indes one consistency results as 


Theorem 3.1 
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4. FSFF Index One Stability Analysis for Smooth 


Systems of Differential/Algebraic Equations 


cw we will prove stability of cur FSFF biock implicit one-step 
methods (1.9) epplied to nonlinger, Gecouzlec index ore systems of 
iiferential/eigesraic equations of the form (3.1). Gur stasility analysis 


Cen be Surimsrized es follows: The family of mappings 5:5," = 62", define 


; sigetiene fT A wees (5 seer dees = Beit (es = 
in Sguatione {2.4} will be considered. {{ will be shown that u(ie']), the 

a on 1 ay c mls if = TiT i+ t 
Fréchet derivative of G, 6¢ [1], exists on Spg(lv}}, where ¢ = WT zl ise 


s6tisties (2.12) and (2.13) - the hypothesis of Lemma 2.i. 


To verify (2.12), it will be shown thet if WZ}, i¢ the unique salution te 
if ' 1 
Lyte op fe ips = LX (4.03 


(vehere (4 ie and (pip, will be defined shortly), end if there exists a 
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4.1 Derivation of the Frechet Derivative 
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